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SYSTEM AND METHOD OF 
8ELECTINO AMONG MDLTIPLB DATA STREAMS 



lliiftVgmimil nfthtf fn^tlon 
1. FIridnffhefnvwiHnn 

This Invention relates to the processing and outputUng of multiple 
data streams from computer data storage peripherals and, more partlcu- 
10 larljr. to a system and method of selecting among multiple data streams in 
peripherals having greater access times for non-sequential data reads than 
for sequential data reads. 

a. Pescr^ptton of theRglated Art 

In the field of computer data storage peripherals, "access time" is 

15 defined as ttie time it takes for a peripheral to access the storage medium 
and retrieve an dement of data. For many^ peripherals, including compact 
disc read-only memory (CD-ROM) drives, the access time of a non-se- 
quential read is greater than that of a sequential read. The difiierence in 
access time may occur for a variety of reasons: in a CD-ROM system it is 

20 primarily due to the additional time required for the lens to physically 
move across the surface of the medium In a non-sequential read. This 
additional time is called "seek time". During the seek time, no data may 
be read from the storage medium. 

For example, a typical CD-ROM drive can read a contiguous stream of 

25 data (in other words, a series of sequential reads), at a rate of approxi- 
mately 150 kilob3rtes per second. To perform a non-sequential read, how- 
ever, the drive's lens must stop and seek the location of the new data, 
which takes approximately 0.5 to 1.0 seconds. 

In many typical CD-ROM applications, a series of sequential reads is 

30 performed, followed by a seek performed in response to end-user inter- 
action. For example, the CD-ROM may contain data representing motion 
video (with associated sound chaxmels). and at a certain point the user 
may have an opportunity to select from a number of "streams" of video. In 
response to the user's selection, the application may have to perform a 
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seek to retrieve the selected stream* Conventionally, no data is trans- 
ferred during this seek, and the video display pauses tintll the seek is 
completed. 

For many applications, such as video games* this interruption in out- 
5 put is tmdesirable, as it interferes with the effective use or enjoyment of 
the application. 

fjl^mifi^iiTy^ 9f thii Invention 
In accordance with the present invention, there is provided a sys- 
tem and method of selecting and switching among miiltiple data streams 
10 instantaneously and without interruption in the output to the end user. 
This is accomplished either by reading data stream elements from a buffer 
to cover a seek, or by using interleave techniques to avoid seek operations 
altogether. 

For purposes of illustratibn, the invention is herein described in 

15 tenns of video data streams stored on CD*ROMs. Each data stream has a 
number of contiguous elements, representing individual frames of video 
data. However^ the invention is not limited to any particular type of data 
or any particular storage medium. It is most usefril when practiced on 
media having longer access times for non-sequential reads than for se- 

20 quential reads. 

One technique for eliminating interruptions according to the pre- 
sent Invention involves loading a buffer with a number of elements from 
one or more data streams prior to performing a seek. When a seek Is 
performed, the application reads elements from the buffer to cover the 

25 seek. Once the seek is complete, normal sequential operation resumes.. 
Thus, the user does not see any interruption in the video output. 

Several variations on this principle are possible. In a preferred em- 
bodiment, the buffer is loaded while sequential reads are taking place. 
The application reads the data stream faster than it displays it, and uses 

30 the extra time to acctmiulate data in the buffer. In other embodiments, 
the buffer is pre-loaded before sequential reads begin. 

Another technique uses interleaving to avoid seek operations alto- 
gether. In this technique, the data storage medium is designed so that 
images from the alternate data streams are interleaved. The system reads 

35 the interleaved elements sequentially, buffering them if required, and out- 
puts only those elements belonging to the selected data stream. These al- 
ternatives and others are described more fully below. 
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In all of these embodiments, the user may select data streams at any 
time. In some embodiments, the displ£^ immediately switches to the se- 
lected data stxieam: in others, the data stream being displayed at the time 
the selection is made continues until the buffer contains enough data to 
5 cover a seek or an interieave gap. In all embodiments, the output seen by 
the user continues uninterrupted. 

Brief Description of the Drawings 
Figure 1 is a block diagram of apparatus for practicing the present 
invention. 

10 Figure 2 is a flowchart showing a method of selecting among multi- 

ple data streams according to the present invention, in \diich excess data 
is accumulated over time to cover seeks. 

Figures 3a and 3b are timing diagrams illustrating an example of the 
mettiod shown in Figure 2. 

15 Figure 4 is a flowchart showing a method of selecting among multi- 

ple data streams according to the present invention, using redundant low- 
res61utl<»i versions of the data to cover seeks. 

Figures 5a and 5b are timing diagrams illustrating an example of ttie 
method shown in Figure 4. 

20 Figure 6 is a flowchart showing a method of selecting among multi- 

ple data streams according to the present invention, in which the bufifer is 
loaded with data from the first data stream in advance of any data output, 
to cover seeks. 

Figures 7a and 7b are timing diagrams illustrating an example of the 
25 method shown in Figure 6. 

Figure 8 is a flowchart showing a variation of the method shown in 
Figure 6. in vMcib. the buffer is loaded with data from two data streams, to 
cover sedcs. 

Figures 9a and 9b are timing diagrams illustrating an example of the 
30 method shown in Figure 8. 

Figure 10 is a flowchart showing a variation of the method shown in 
Figure 6. In vfbidi the buffer is loaded with data from the second data 
stream to cover seeks. 

Figures 11a and lib are timing diagrams iUustrating an example of 
35 the method shown in Figure 10. 

Figure 12 is a flowchart showing a method of selecting among multi- 
ple data streams according to the present invenUon. in which data is 
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Stored In an interleaved fashion, and elements £rom all data streams are 
read in each time frame. 

Figures 13a and ISb are timing diagrams illustrating an example of 
the method shown In Figure 11. 
5 Figure 14 is a flowchart showing a method of selecting among multi- 

ple data streams according to the present invention, in which excess data 
is accumulated over time to cover interleave gs^s. 

Figures 15a and 15b are timing diagrams illustrating an example of 
the method shown In Figure 14. 

10 Description cf the PrefeTf^H iCiiih«wH^«>|^^ 

Refisrring now to Figure 1, tiiere ia shown a functional block diagram 
of apparatus for practicing the present invention. In the preferred 
embodiment^ one or more central processing units (CPU) 101 perform 
the steps of the method, althou^ any type of processor or multiple 

IS processors may be used. CPU 101 controls the operation of a data storage 
device containing the various data streams which are to be read and 
processed. An example of such a data storage device is CD-HOM drive 102 
shown In Figure 1. In response to control signals from CPU 101. data 
from CD-ROM drive 102 is sent to random-access memory CRAM) 103 via 

20 direct memoiy access (DMA) transfers. CPU 101 controls the operation of 
a buffer which is contained in RAM 103 and which temporarily stores data 
stream elements in accordance with the method described below. Video 
display 104 receives data from RAM 103 via DMA transfers and outputs 
the data to fht user. In the prtferred embodiment the data contains both 

25 video and audio components, and the video display includes audio output 
capability. 

Alternative structures may be used to practice the current invention. 
For example, if the data represents audio onty. an audio ou^ut device may 
be substituted for video display 104. Similarly, alternative data storage 
30 devices may be employed in place of CD-ROM drive 102. Other variations 
are also possible. 

For purposes of illustration. Figures 2 through 15b show implemen- 
tations involving two data streams, designated A and B. Elements from 
stream A are output first and then the user is given an opportunity to ei- 
35 ther remain on stream A or select stream B. All of these techniques may 
be extended to multiple data streams. Figures 2 through lib show im- 
plementations which use seek operations, and Figures 12 through 15b 
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show Implementations which use Interleave techniques to avoid seek op- 
erations. 

Referring now to Figure 2, there is shown a flowchart of a preferred 
embodiment of the present invention. In this embodiment, the data 
5 stream is read from the storage device foster than it is output A buffer is 
used to temporarily^ store elements of the data stream between the time 
they are read and the time they are ou^t Since the read rate is faater 
than the output rate, excess data accimiulates in the buffer over time. 
Once the buffer has accumulated enou^ data to cover a seek, selection 

10 among data streams becomes possible. Ihe point in time at which selec- 
tion is possible is called the selection Jimction. If the user specifies his or 
her selection before the selection Junction is reached, the system contin- 
ues outputting elements from the first data stream until the Junction is 
reached. Once the Junction is reached, if a seek is required to access the 

15 selected data sUream, elements are drawn from the buffer while the seek 
takes place. Thus, the output to the user is uninterrupted. 

In step 201, the process begins. Two paths extend from step 201, 
one leading to steps 206 through 209 and one leading to step 210. In this 
and aOaex flowcharts, this designation indicates that the two paths occur 

20 simultaneously. In other words, steps 206 ttuough 209 are performed at 
the same time as step 210 is performed. The two paths may be per- 
formed by a single processor or by two different processors. 

In steps 206 through 209, the system reads successive elements 
from the storage device and places each element in the buffer as it is read. 

25 Some elements belong to stream A and some elements belong to stream B. 
Typically, each element has a tag to indicate which stream it belongs to, 
and the data is arranged on the storage medium so that a set of stream B 
elements is located immediately after a set of stream A elements. Alter- 
natively, other techniques may be used to identify the stream to which 

30 each element belongs, ff, \i^e the system Is reading dements, the buffer 
becomes full, tills Is detected m step 208 and the reading process pauses 
In step 209. allowing the ou^ut to catbh up imtll the buffer is no longer 
fail. After each element is read, the system checks In step 207 to see If 
the sdection Junction has been reached. If so. the system immediately 

35 proceeds to step 211. If the selection Junction has not been reached, the 
system checks to see if the buffer is full in step 208. pauses in step 209 if 
necessary, and loops back to step 206^ 

Simultaneously with steps 206 through 209. step 210 is performed. 



wo 94/03851 



-6- 



PCr/US93/05780 



In "wtiLdi the ou^ut device starts to ou^ut stream A elements from the 
buffer. This is done at a rate wtiLch is slower than the read rate, so ^H^^t 
the system is able to accumulate excess data in the buffer before the se- 
lection Junction is reached at step 207. Thus, by the time the system 
5 reaches step 211, the buffer contains enou^ elements from stream B to 
cover a seek. 

In step 211. the system accepts input from the user specifying the 
desired stream. The user may suppty this input at any time, but in this 
embodiment, the system does not respond to the selection untU the sdec- 

10 tion Junction is reached. In step 212, the system chedcs the input to see 
which stream was selected. 

If stream A is selected, the process continues with steps 213 
through 217 running simultaneously with step 218. In step 213. stream B 
clients are discarded from the buffer, since they are not needed. This 

15 laay be done before, after, or during steps 214 through 217. In steps 214 
through 217. the system reads successive stream A elements and places 
them in the buffer, until it has finished reading stream A. As before, if the 
buffer becomes full, the reading process pauses in step 217 to let the out- 
put catch up. "Whae steps 213 through 217 are being performed, the siys- 

20 tem outputs successive stream A elements 6mm the buffer in step 218. 
until stream A is finished. Once stream A is finished, the process ends in 
step 226. 

If, in step 212, stream B is selected, the process continues with 
steps 219 through 224 running simultaneously with step 225. In step 

25 219, stream A elements are discarded from the buffer, since they are not 
needed. This may be done before, after, or during steps 220 through 224. 
In step 220, the system performs a seek to access stream B. Once the 
seek is complete, in steps 221 through 224. the system reads successive 
stream B elements and places them in the buffer, until it has finished 

30 reading stream B. As before, if the buffer becomes full, the reading pro- 
cess pauses in step 224 to let the output catch up. While steps 219 
through 224 are being performed, the system outputs successive stream B 
elements from the buffer in step 225, until stream B is finished. Once 
stream B is finished, the process ends In step 226. 

35 Referring also to Figures 3a and 3b. there are shown timing dia- 

grams illustrating an example of the method of Figure 2. Figure 3a shows 
the user electing to remain on stream A, and Figure 3b shows ttie user 
selecting stream B. Each timing diagram contains five horizontal rows of 
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Infomiatlon. In the top row, a time stream of eight frames, time 1 to' time 
8. is shown. In the next row, the diagram shows elements being read 
from the storage device. Each element of the data streams is labeled with 
a letter and a number, the letter specifying ix^ch data stream the element 
5 belongs to, and the number specifying the proper time for the element to 
be output The third row of each diagram shows elements being output 
The fourth row shows the contents of the buifer at each point In time. 
The last row shows elements being discarded from the buffer. 

In time frames 1 to 3, the system reads elements Al through A5, 

10 placing each element in the buffer. This corresponds to steps 206 
through 209. At the same time, elements Al through A3 are output 
(corresponding to step 210). Then the system reads elements B5 and B6 
In frames 3 to 4, since these are positioned on the storage medium im- 
mediately after elements Al to A5 (continuing steps 206 through 209). 

15 Meanix^e. frames A3 through A4 are being output (step 210). At the end 
of frame 4. the selection Junction has been reached, and the i^tem Is 
prepared to accept selection input (step 211). At this point the buffer 
contains elements A5 and B5. and B6 has been read and Is reacfy to be 
placed in the buffer. Thus, there is sufficient data in the buffer to cover a 

20 seek, should the user select stream B. 

If the user elects to remain on stream A. the example continues as 
in Figure 3a. Elements B5 and B6 are discarded from the buffer (step 
213) at the beginning of frames 5 and 6 respectively (although this can be 
done at any time). In frames 5 through 6, the system reads elements A6 

25 throu^ A8 (steps 214 to 217). At the same time. In frames 5 throu^ 8. 
it outputs elements A5 through A8 from the buffer (step 218). Stream A 
finishes with element A8 (step 226). 

If the user selects stream B, the example continues as in Figure 3b. 
Element A5 Is discarded from the buffer (step 219) at the beginning of 

30 frame 5 (although this can be done at any time). In frames 5 and 6. the 
^tem performs a seek to access stream B (step 220). Since the buffer 
contahis elements B5 and B6, the system is able to cover the seek by out- 
putting these elements (step 225), Once the seek is completed, in frame 
6. the system begins to read stream B elements. The eystem reads ele- 

35 ments B7 and B8 in frames 6 and 7 and places them In the buffer (steps 
221 to 224). At the same time. It outputs elements B6 through B8 from 
the buffer (continuing step 225). Stream B finishes with element B8 (step 
226). 



wo 94/03851 



-8 - 



PCr/US93/05780 



The technique of Figures 2. 3a. and 3b may be extended to multiple 
data streams, multiple selection Junctions, or both. The user may make 
his or her selection at ai^ time, but the system will continue on its cur- 
rent data stream tmtil the next selection Jtmctlon is reached. 
5 Referring now to Figure 4, there is shown a flowchart of another 

prefenred embodiment of the present invention. In this method, the sys- 
tem responds to the user's selection immediately after the selection is 
made. As in the method of Figure 2, the data stream Is read from the 
storage device faster than It is output so that excess data accumulates in 

10 the buffer. In this technique, however, two versions of each data stream 
are stored on the storage device: a high-resolution version and a low-reso- 
lution version. Each high-res element of one stream is paired with a low- 
res element of the other stream. If the- user selects a stream requiring a 
seek before sufBdent data has accumulated in the buffer to cover the seek. 

15 the system outputs the low-res version of the selected stream, expanded 
as desired using conventional e3q>anslon techniques, until the buffer is full 
enough for a seek. Once the buffer is ready, the syston performs the seek 
and uses the buffi's contents to cover the seek. This technique allows 
ttie system to respond to the user's selection before the buffer is ready for 

20 a seek, althou^ Uie quaUty of the output during the interim period from 
the time the selection is made until the completion of the seek may be 
Inferior because It Is an expanded low-res version of the data stream. This 
technique also facilitates outputtlng low-res versions of the non-selected 
data stream, e.g.. in a smaller, secondaiy video window, while the high-res 

25 version of the selected data stream is being ou^ut in the primary video 
window. 

In step 401, the process begins. In steps 402 throu^ 407, the sys- 
tem reads successive hi^-res stream A elements paired with low-res 
stream B elements, and places eadi pafr in the buffer as it is read. After 

30 each pair is read, the system checks in step 403 to see if the user has se- 
lected stream B. If so, the system immediately proceeds to steps 412 
through 414. If the user has not selected stream B, the system checks in 
step 404 to see If stream A is finished: if so the system ends the process 
in step 405. If stream A is not finished, the systeiiai checks to see if the 

35 buffer is full in step 406, pauses in step 407 if necessary, and loops back 
to step 402. 

Simultaneously with steps 402 through 407, steps 408 through 411 
are performed, in which the output device outputs successive hi^-res 
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versions of stream A elements .and. optional^ in the secondary displiQi:, 
low-res versions of stream B elem^ts. This is done at a rate whidi is 
slower than the read rate, so that the s^ystem is able to accumulate excess 
data in the buffer over time. After each element is output, the system 
5 checks in step 409 to see if the user has selected stream B; if so. the 
tem immediately proceeds to steps 412 through 414. If the user has not 
selected stream B. the system checks in step 410 to see if stream A is 
finished: if so. the system ends the process in step 41 1. If stream A is not 
finished, the system loops back to step 408 to output the next element 

10 If at ai^ time the user selects stream B. the system starts to perform 

steps 412 and 413 ^multaneously with step 414. In step 412, the system 
reads successive high-res stream A elements and low-res stream B ele- 
ments and places them in the buffer. It continues to do this until the 
buffer is full enou^ to cover a seek. When the buffer is lull enough, the 

15 system proceeds to step 413. where it performs a seek to access high-res 
stream B elements. While steps 412 and 413 are being performed, the 
output device in step 414 ou^uts successive low-res stream B elements 
which have been expanded feom the buffer. Optionally, the device also 
displays the corresponding high-res stream A elements, reduced if de- 

20 sired by conventional reduction techniques, in the secondary dispU^. 
Thus, the ^tem immediatdy responds to the user^s selection of stream 
E 

After the seek is complete, the system proceeds with steps 415 to 
418, performed simultaneously with step 419. In steps 415 through 418, 

25 the system reads successive high-res stream B elements and low-res 
stream A elements, placing each pair in the buffer, until it has finished 
reading stream B. As before, if the buffer becomes full, the reading pro- 
cess pauses in step 418 to let the output catch up. While steps 415 
through 418 are being performed, the system ou^uts successive high-res 

30 stream B elements and. optionally, low-res stream A elements in the sec- 
ondaiy display, from the buffer in step 419. unta stream B is finished. 
Once stream B is finished, the process ends in step 420. 

Referring also to Figures 5a and 5b. there are shown timing dia- 
grams illustrating an example of the method of Figure 4. Figure 5a shows 

35 the user electing to remain on stream A. and Figure 5b shows the user 
selecting stream B. The timing diagrams show information in a similar 
manner as Figures 3a and 3b. In Figures 5a and 5b, however. A and B in- 
dicate high-res versions of the data streams, and a and b indicate low-res 
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versions. B' indicates an expanded low-res version, and a* indicates a re- 
duced bl^-res version. A high-res version firom one data stream is alwsQrs 
paired ivith a corresponding low-res version from the other data stream. 
The secondaiy video window may or may not be displ£Qred. 
5 hi Figure 5a. the user elects to remain on stream A. In time frames 

1 to 3. the system reads element pairs Abl fiirough Ab5, placing each pair 
in the buffer. Ihis corresponds to steps 402 through 406. In frame 3, the 
buffer becomes full, so the reading process pauses to let the output catch 
up (step 407). At the end of frame 4, the output has caught up, so the sys- 

10 tem continues reading element pairs Ab6 through Ab7 in frames 5 and 6. 
In frame 6, tiie data stream ends, so the system stops reading elements 
(step 405). While all this is taking place, in frames 1 through 7. the out- 
put device reads successive element pairs from the buffer, outputting 
hi^-res stream A elements and, optionally, low-res stream B elements 

15 (steps 408 through 410). When the ouQ)ut device reaches element pair 
Ab7, it has finished the data stream, and stops outputting (step 411). 

In Figure 5b, as before, by the end of time frame 1 the system has 
read element pairs Abl through Ab2 (steps 402 through 406). At the 
same time, in frame 1, the output device ou^uts element pair Abl (step 

20 408). Also during frame 1. the user selects stream B. At this point in 
time, the buffer is not frill enough for a seek, so the ^tem continues to 
read element pairs from the same data stream, namely Ab3 through Ab5, 
during fixunes 2 to 3 (step 412). Once the system has read element pair 
Ab5, in frame 3, the buffer is frill enough for a seek, so the system per- 

25 forms a seek in frames 3 to 4 (step 413). Meanwhile, during frames 2 
through 5. the output device outputs ejqsanded stream B elements paired 
with reduced stream A elements, indicated as elements a'B'2 through 
aB'S (step 414). Thus, the user starts to see stream B elements Immedi- 
ately after he or she has selected stream B. 

30 Once the seek is completed, in frames 5 and 6. the system reads el- 

ement pairs aB6 through aB7 (steps 415 through 417). Concurrently, in 
frames 6 throu^ 7. the output device ou^ute from the buffer high-res 
stream B elements and. optionally, low-res stream A elements (step 419). 
The data stream finishes with element pair aB7, and the process ends 

35 (step 420). 

The technique of Figures 4, 5a, and 5b may be extended to multiple 
data streams, multiple selection junctions, or both. The user may mal^ 
his or her selection at any time, and this selection will be reflected im- 
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mediate^, using e]q>anded or reduced ou^ut if necessaxy. Ibe user may 
also switch back and forth between data streams at any time, including 
during time frames when an e9q)anded element is bdng ou^t 

Referring now to Figure 6, there is shown a flowchart of another 
5 prefenred embodiment of the present invention. In this method, the lead 
rate need not necessarily be faster than the output rate. Rather than ac« 
cumulating the buffer over time, the buffer is pre-loaded before output 
begins. This may be done at the beginning of the session, or during a nat- 
ural break in the video dlsiday. This technique allows the output device to 
10 use the full consecutive-read bandwidth of the storage device. 

In step 601. the process begins. In step 602. the system reads a 
number of elements from stream A and places them in the buffer. Then, 
steps 603 and 604 are performed simultaneously. In step 603. another 
stream A element is read and placed in the buffer. Meanwhile, in step 
15 604. the ou^ut device outputs a stream A element that was previously 
placed in the bt^er. These two operations m^ be done at the same rate, 
so that the ^tem is alwie^ "ahead" of the display device a constant 
number of frames (equal to ttie number of frames that were pre-loadied in 
step 602). 

20 After steps 603 and 604 are pexfonned. the system checks in step 

605 to see if the user has selected stream B. If the user has not selected 
stream B. and if there are any more stream A elements (step 606). the 
process loops back to steps 603 iand 604. If there are no more stream A 
elements, the process ends (step 611). 

25 If the user selects stream B. the system immediately performs a 

seek in step 607. The system covers the seek by outputting successive 
stream A elements from the buffer in step 608 while the seek is in 
progress. Once the seek is completed, the system proceeds to step 609. 
where it discards stream A elements from the buffer, as they are no longer 

30 needed. Step 609 may be perfonned before, during, or after step 610. In 
stiep 610. the system reads and ou^uts successive stream B elements 
until stream B is finished: during this step, the system no longer needs to 
store elements in the buffer. If desired, however, the system may con- 
tinue to use the buffer in anticipation of future selection among data 

35 streams. Once stream B is finished, the process ends in step 611. 

Referring also to Figures 7a and 7b. there are shown timing dia- 
grams illustrating an example of the method of Figure 6. For illustrative 
purposes, the read rate is shown to be the same as the ou^ut rate. Figure 
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7a shows the user electing to remain on stream A. and Figure 7b shows 
tile user selecting stream B. The timing rtingmmft show information in a 
similar manner as Figures 3a and Sb. 

In Figure 7a. the user elects to remain on stream A. Prior to time 
5 frame 1, the system reads elements Al through A3 and loads them into 
the buffer (step 602). Then, ih each time frame from 1 throu^ 5. the 
system reads a stream A element and places it in the buffer (step 603). 
while the ou^ut device outputs a previously stored element (step 604). At 
the end of frame 5. the system has read the last element in the stream, so 

10 it stops reading elements. The output device continues oulputting de- 
ments A6 through AS in frames 6 through 8. When stream A is finished, 
the process ends (step 611). 

In Figure 7b. the user selects stream B. As before, prior to time 
frame 1. the system reads elements Al through A3 and loads them into 

15 the buffer (step 602). Then, in each time frame from 1 through 4. the 
^tem reads a stream A dement and places it in the buffer (step 603). 
vfbUe the output device outputs a previously stored elemoit (step 604). At 
the end of frame 4. the user sdects stream B (st^ 605). The stystem im- 
mediately, in frame 5, performs a seek to access stream B (step 607). 

20 wbUe the oulput device outputs successive stream A dements from the 
buffer in frames 5 and 6 (step 608). In frame 6. the seek is completed, 
and the system reads and ou^uts dements B7 and B8 (step 610), discard- 
ing element A7 since it is not needed (step 609). Stream B ends at ele- 
ment B8. and the process stops after that element has been displayed in 

25 frame 8 (step 611). 

As seen in the above description, the user's selection is not immedi- 
ately reflected in the output, since the system continues to display stream 
A elemoits until after the seek is complete. 

The technique of Figures 6. 7a. and 7b may be extended to multiple 

30 data streams or multiple selection Junctions, or both. One way to imple- 
ment multiple Junctions would be to pre-load enough elements in step 
602 to cover several seeks. 

Rdierring now to Figure 8. there is shown a flowchart of another 
preferred embodiment of the present invention. As in the method of Ftg- 

35 ure 6. the buffer is pre-loaded before output begins, and the read rate 
need not necessarfly be feister than the output rate. Thus, again, the out- 
put device may use the full consecutive-read bandwidth of the storage de- 
vice. This method differs from that of Figure 6 in that elements from 
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Stream B are placed in the buffer in advance of the selection Junction. 
This allows the user's selection to be reflected Instantaneously after it is 
made, but only if the selection is made at a predetermined selection Junc- 
tion. 

5 In step 801 the process begins. In step 802. the system reads a 

number of elements from stream A and places them in the buffer. Then, 
steps 806 and 807 are performed simultaneously. In step 806, the system 
reads the next element and places It In the buffer. This element may be a 
stream A element or a stream B element Typically, each element has a 

10 tag to indicate which stream it belongs to. and the data is arranged on the 
storage medium so that a set of stream B elements is located immediately 
after a set of stream A elements. Alternatively, other techniques may be 
used to Identify the stream to which each element belongs. Meanwhile, in 
step 807, the ou^ut device outputs a stream A element that was prevl- 

15 ousty placed in the buffer. These two operations may be done at the same 
rate, so that the system is always "ahead" of the display device by a con- 
stant number of frames (equal to the number of frames that were pre- 
loaded in step 802). Steps 806 and 807 repeat until the system reaches 
the selection Junction. 

20 In step 809. the qrston accepts input from tiie user specifying the 

desired stream. The user may supply this input at any time, but in this 
embodiment the system does not respond to the selection until the selec- 
tion Junction is reached. In step 810. the system checks the Input to see 
which stream was selected. 

25 If stream A is selected, the process continues with steps 811 

through 812. In step 811 the ^tem discards the stream B elements that 
were placed in the buffer, as they are not needed. This may be done be- 
fore, after, or during step 812. In step 812. the ^tem reads and outputs 
successive stream A elements untU stream A is finished. The system no 

30 longer needs to store elements in the buffer, but it may do so if desired in 
anticipation of future selection among data streams. Once stream A is fin- 
ished, the process ends in step 817. 

If. in step 810. stream B is selected, the system performs steps 813 
and 814, simultaneously with step 815. In step 813 it discards the stream 

35 A elements that were placed in the buffer, as they are not needed. This 
may be done before, after, or during step 814. bi step 814. the system 
performs a seek to access stream B. Meanwhile, in step 815, the system 
ou^uts the stream B elements from the buffer to cover the seek. Once 
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the seek ia completed, the system proceeds to step 816, where it reads 
and outputs successive stream B elements until stream B is finished. 
Again, the system no longer needs the buffer, but it may use it if desired in 
anticipation of future selection. Once stream B is finished, the process 
5 ends in step 817. 

Referring also to Figures 9a and 9b. there are shown timing dia- 
grams illustrating an example of the method of Figure 8. For illustrative 
puzposes, the read rate is shown to be the same as the output rate. Figure 
9a shows the user electing to remain on stream A. and Figure 9b shows 

10 the user selecting stream B. The timing diagrams show information in a 
similar manner as Figures Sa and 3b. 

In both Figures 9a and 9b, prior to time frame 1. the system reads 
elements Al through A3 and loads them into the buffer (step 8Q2). Then, 
in each of time firames 1 and 2. the ^tem reads a stream A element and 

15 places it in the buffer (step 806), while the ou^ut device ou^uts a previ- 
ously stored element (step 807). In firames 3 and 4. the system reads ele- 
ments B5 and B6. respectlvefy (step 806), since these are the next two el- 
ements stored on the storage device, while the output device outputs 
ficames A3 and A4 firom the buffer (step 807). 

20 At the end of firame 4. the system reaches the sdection Junction, 

and is prepared to accept selection input (step 809). At this point, the 
buffer contains elements A5 and B5. and B6 has been read and is reaciy to 
be placed in the buffer. Thus, there is sufilcient data in the buffer to cover 
a seek, should the user select stream B. 

25 If the user elects to remain on stream A. the example continues as 

in Figure 9a. The ou^ut device outputs element A5 In frame 5 (step 812). 
Elements B5 and B6 are discarded from the buffer (step 811) at the be- 
ginning of frame 6 (although this can be done at any time). The system 
reads and outputs elements A6 through AS in successive frames (step 

30 812). until stream A is finished. 

If the user selects stream B at the selection Junction, the example 
continues as in Figure 9b. The system discards element A5 from the 
buffer (step 813) in frame 5 (although this can be done at any time). The 
^tem immediately performs a seek, in firame 5. to access stream B (step 

35 814). Meanwhile, the output device outputs elements B5 and B6 from the 
buffer in firames 5 and 6 to cover the seek (step 815). Once the seek is 
complete, the qrstem reads and outputs elements B7 and B8 in successive 
frames (step 816). until stream B is finished. 
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The technique of Figures 8. 9a. and 9b may be extended to multiple 
data streams, multiple selection Junctions, or both. The user may make 
his or her selection at any time, but the system -will continue on its cur- 
rent data stream until the next selection Junction is reached. Altema- 
5 tively, the methods of Figures 6 and 8 m^ be combined so that the system 
loads stream B elements in the buffer in anticipation of a selection Junc- 
tion as in Figure 8. but if the user selects stream B before the required 
stream B element have been loaded, the system uses the Figure 6 method. 
Refexilng now to Figure 10. there is shown a flowchart of another 

10 preferred embodiment of the present invention. As in the previous two 
methods, the buffer is pre-loaded before output begins, and the read rate 
need not necessarily be faster than the ou^ut rate. In this method, how- 
ever, the system pre-loads elements from stream B needed to cover the 
seek. Once the buffer is pre-loaded, it is not accessed until the selection 

15 Jimction is readied: elements of stream A are read and output without ac- 
cessing the buffer. If the user selects stream B. the system oui^uts the 
pre-loaded elements to cover the seek. 

In step 1001 the process begins. In step 1002. the system reads 
enou^ stream B elements to cover a seek (or more than one seek, if de- 

20 sired), and places them In the buffer. Then, in steps 1003 and 1004. the 
^tem reads and ou^ts successive stream A elements, without using the 
buffer, until the sdectipn Junction is reached. 

Once the selection Junction is reached, the system, in step 1005. 
accepts input from the user specifying the desired stream. The user may 

25 supply this input at any time, but in this embodiment the system does not 
respond to the selection until the selection Junction is reached. In step 
1006. the system checks the input to see which stream was selected. 

If the user elects to remain on stream A. the process continues with 
steps 1007 through 1008. In step 1007. the system discards the stream 

30 B elements that were placed in the buffer, as they are not needed. This 
may be done before, after, or during step 1008. In step 1008, the system 
reads and outputs successive stream A dements imtil stream A is finished. 
Again, the buffer is not needed, but it may be used if desired in antldpa- 
tion of future selection. Once stream A is finished, the process ends in 

35 step 1012. 

If, In step 1006, stream B is selected, the ^tem performs step 
1009 simultaneously with step 1010. In step 1009. the ^tem performs 
a seek to access stream B. Meanwhile, in step 1010, the ou^ut device 
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outputs the pre-loaded stream B elements from the buffer to cover the 
seek. Once the seek Is completed, the system proceeds to step 1011, 
where it reads and outputs successive stream B elements tmtil stream B is 
finl^ed. Again, the ^tem no longer needs the buffer, but it may use it if 
5 desired in anticipation of future selection. Once stream B is finished, the 
process ends in step 1012. 

Referring also to Figures 11a and lib, there are shown timing dia- 
grams illustrating an example of the method of Figure 10. For iUustrattve 
puxi)oses. the read rate is shown to be the same as fhe output rate. Figure 

10 11a shows the user electing to remain on stream A. and Figure lib shows 
the user selecting stream B. Ihe timing diagrams show information in a 
similar manner as Figures 3a and 3b. 

In both Figures 1 la and 1 lb. prior to time firame 1, the system reads 
elements B5 through B6 and loads them into the buffer (step 1002). 

15 Then, the system reads and outputs dements Al throu^ A4 (step 1003). 
without accessing the buffer. At the end of time frame 4, when the selec- 
tion junction is reached, the system has displayed element A4 and has Just 
read element A5 and Is ready to display it. The buffer still contains ele- 
ments B5 and B6, sufficient to cover a seek should the user select stream 

20 a 

If the user elects to remain on stream A, the example continues as 
in Figure 11a. Ihe output device outputs element A5 in frame 5, and con- 
tinues to read and ou^ut successive elements A6 through AS (step 1008), 
until stream A is finished. At some point, the ^tem discards elements 

25 B5 and B6 from the buffer, as they are not needed (step 1007). 

If the user selects stream B at the selection Jimiction. the example 
continues as in Figure lib. The system immediate^ performs a seek in 
frame 5 (step 1009), outputting elements B5 and B6 to cover the seek 
(step 1010). Once the seek is completed, the system reads and ou^uts 

30 frames B7 and B8 in succession (step 1011). until stream B is finished. 

The technique of Figiires 10. 11a. and lib may be extended to mul- 
tiple data streams, multiple selection Junctions, or both. The user may 
make his or her selection at any time, but the system will continue on its 
current data stream until the next selection Junction is reached. Altema- 

35 ttvdy. the methods of Figures 6 and 10 may be combined so Ibat the sys- 
tem pre-loads stream B elements for a specific selection Junction as In 
Figure 10. but if the user selects stream B before the Junction is reached, 
the system uses the Figure 6 method. 
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Referring now to Figure 12, there Is shown a flowchart of another 
preferred embodiment of the present Invention. This method does not 
use seek oporeitlons. Instead, data is arranged on the storage device in an 
interleaved fisishion. so that dements from all data streams for a given time 
5 frame are positioned consecutively. In each time frame, the system reads 
an of the elements from all of the data streams for that frame, and ou^uts 
only the element from fht selected data stream. Thus, in the case of Iwu 
interleaved data streams, elements from each data stream are alternate 
placed on the storage device, and the system reads an element from 

10 stream A and one from stream B in each frame, oulputtlng only the se- 
lected one. This technique allows the user to select either stream at any 
time, and the system responds Immediately. However, this technique 
limits the bandwidth available for ou^t as explained below. 

In step 1201. the process begins. In step 1202. the system reads 

15 the first element of all of the data streams. Then the system proceeds to 
step 1203, simultaneous^ with steps 1204 and 1205. In step 1203, the 
^tem reads the next element of all of the data streams. While it does 
this, in step 1204 It deteimlnes vtbich data stream Is currently sdected 
and in step 1205 the ou^ut device ou^ts the element for tht selected 

20 data stream which was most recent^ read. As Icmg as tfaore is more data 
. to be read from the storage device, this loop continues. Once the system 
is finished with the data, the process ends in step 1207. 

Referring also to Figures 13a and 13b. there are shown timing dia- 
grams illustrating an example of the method of Figure 12. Figure 13a 

25 shows the user electing to remain on stream A, and Figure 13b shows the 
user selecting stream B. 

In Figure 13a. the user elects to remain on stream A. Prior to frame 
1, the system reads elements Al and Bl (step 1202). Then, in each frame 
from 1 to 5, the sjrstem outputs the A element for that frame (step 1205) 

30 and simultaneously reads the A and B elements for the next frame (step 
1203). 

In Figure 13b, the usor selects stream B. Prior to frame 1. the sys- 
tem reads elements Al and Bl (step 1202). In frames 1 and 2. as before, 
fht system ou^uts the respective A elements (step 1205) and reads both 
35 A and B elements (step 1203). During frame 2, the user selects stream B. 
In frame 3, the ^tem responds to this selection by outputting element 
B3 instead of A3 (step 1205). It still reads both A4 and B4. For the re- 
maining frames, system ou^uts successive B elements while reading A 
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and B elements for the next frame. 

In the technique of Figures 12. 13a. and 13b, a mavim»tti of N data 
streams are avaflable for selection at any given time, where N Is the Inter- 
leave factor of the data storage device. Furthermore, the output device Is 
5 only able to use 1/N of the consecutive-read bandwidth of the storage de- . 
vice (e.g.. for the scheme shown In Figures 13a and 13b. only half of the 
consecutive-read bandwidth Is available). The user may select among the 
data streams at any time, and multiple selections are possible. The system 
responds to the user's selection Immediately after it is made. 

10 Referring now to Figure 14. there is shown a method which permits 

more than 1/N of the consecutive-read bandwidth of the storage device to 
be used, hi this method, as In the method of Figure 2. the data stream Is 
read from the storage device fester than It is output, and a buffer is used so 
that excess data can accumulate over time. In this method, however, the 

15 excess is used to cover interleave gaps a.e.. the periods of time when the 
^tem is reading non-selected data stream elements) .rather than seek 
operations. This permits interleaving to be used without limiting the out- 
put bandwidth to 1/N of the consecutive-read bandwidth. However, in 
this method, the system does not respond to the user's selection until the 

20 buffer contains enou^ elements to cover interleave gaps. 

In step 1401. the process begins. In steps 1406 throu^ 1409. the 
system reads successive elements from the storage device and places each 
element in the buffer as it is read. Some elements belong to stream A and 
some elements belong to stream B. Typically, each element has a tag to 

25 indicate which stream it belongs to. and the data is arranged on the stor- 
age medium so that a set of stream B elements Is located Immediately af- 
ter a set of stream A elements. Alternatively, other techniques may be 
used to Identify the stream to which each element belongs. If. while the 
system is reading elements, the buffer becomes full, this Is detected in 

30 step 1407 and the reading process pauses in step 1408. allowing the out- 
put to catch up until the buffer Is no longer fiill. After each element is 
read, the system checks In step 1409 to see if the selection Junction has 
been reached. If so, the system Immediately proceeds to steps 1411 and 
1415. If the selection Junction has not been reached, the system loops 

35 back to step 1406. 

Simultaneously with steps 1406 through 1409. step 1410 is per- 
fonned. in which the output device starts to output stream A elements 
from the buffer. This Is done at a rate ^f/hlch is slower than the read rate, 
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60 that the system Is able to accumulate excess data in the buffer before 
the selection Junction is reached at step 1409. Thus, by the time the sys- 
tem reaches steps 1411 and 1415, the buffer contains enough elements 
from stream B to cover gaps caused by interieave. 
5 During execution of steps 1411 though 1418. the user may select ei- 

ther data stream at aay time, and may even switdi repeated^ between the 
streams, fai steps 1411 through 1414. the sjrstem reads successive inter- 
leaved elements from the data storage device. The dements alternate be- 
tween stream A and stream B. ff the buffer is full, this is detected in step 
10 1413 and the reading process pauses in step 1414 to let the ou^nit catch 
up. 

Simultaneously with steps 1411 through 1414, the system performs 
steps 1415 throu^ 1418. In step 1415, the system determines which 
data stream has been selected. In step 1416, thei ou^ut device outputs 

15 the next element from ttiat data stream from the buffer. This is done at a 
rate which is slower than the read rate. The non-selected dement for the 
current frame is discarded in step 1417. This loop continues tintil the 
data stream is finished. Then the process ends in step 1419. 

Referring also to Figures 15a and 15b. there are shown timing dia- 

20 grams illustrating an example of the method of Figure 14. Figure 15a 
shows the user decting to remain on stream A. and Figure 15b shows the 
user selecting stream B, then returning to stream A. Tlie timing diagrams 
show information in a similar maimer as Figures 3a and 8b. 

In time frames 1 to 3. the system reads dements Al through AS, 

25 placing each dement in the buffer. This corresponds to steps 1406 
through 1409. At the same time, dements Al through A3 are output 
(corresponding to step 1410). Then the system reads dements B5 and 
B6 in frames 3 to 4, since these sure positioned on the storage medium 
immediately after elements Al to A5 (continuing steps 1406 through 

30 1409). Meanwhile, frames A3 through A4 are being output (step 1410). 
At the end of frame 4, the selection Junction has be^ reached. At this 
point the buffer contains elements A5 and B5. and B6 has been read aoid 
is ready to be placed in the buffer. Ihus. there is sufficient data in the 
buffer to cover gaps caused by interleaving streams A and B. 

35 If the user dects to remain on stream A. the example continues as 

in Figure 15a. During frames 5 and 6, dements A6. B7. and A7. vrbldi are 
stored on the storage device in an interleaved fashion, are read succes- 
sively (steps 1411 through 1414). Meanwhile, dements A5 and A6 are 
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output (step 1416). and B5 and B6 are discarded since B is the noh-se- 
leeted data stream (step 1417). At any time during these two firames. se- 
lection of stream B is possible, but here the user elects to remain on 
stream A. At the end of firame 6. there is no longer sufficient data in the 
5 buffer to cover interleave gs^s, so sdection is no longer possible. Element 
B7 is discarded, and the process begins again. Flame 7 is analogous to 
frame 1. 

Figure 15b shows the user selecting stream B during frame 5. As In 
Figure 15a, elements A6. B7. and A7 are read during frames 5 and 6. ele- 

10 ment A5 is output in frame 5. and element B5 is discarded. Once the user 
selects frame B. however, the output device begins outputting stream B el- 
ements instead of stream A elements. Thus, in frame 6. element B6 is 
ou^ut (step 1416) and A6 is discarded (step 1417). and in frame 7. de- 
ment B7 is output and A7 is discarded. During frame 7. the buffer no 

15 longer contains enough data to cover interleave gaps, so the system Is 
forced to return to stream A in frame 8. to btffn the process a^in. Again, 
frame 7 Is analogous to frame 1. 

The technique of Figures 14. 15a. and 15b may be extended to mul- 
tiple data streams, multiple selection Junctions, or both. The user may 

20 make his or her selection at any time, but the system will continue on its 
current data stream imtil the next selection Jtmction is reached. Selec- 
tions made during the period in which there is siifflcient data in the buffer 
to cover interleave gaps (frames 5 through 6 in the example) will be re- 
flected immediately, and the user may switch repeatedly among data paths 

25 during this period. 

From the above description, it will be apparent that the invention 
disclosed herein provides a novel and advantageous method of selecting 
among multiple data streams. The foregoing discussion disdoses and de- 
scribes merely exemplary methods and embodiments of the present in- 

30 vention. As will be tmderstood by those familiar with the art. the invention 
m^ be embodied in other specific forms without departing from the spirit 
or essentia] characteristics thereof. For example, different methods of ac- 
cumulatliig data in the buffer may be used in place of those described in 
the above description and corresponding diagrams. Also, any of the meth- 

35 ods described above can be extended to multiple data streams and multi- 
ple selection Junctions. Accordingly, the disdosure of the present taven- 
Uon is intended to be illustrative, but not limiting, of the scope of the in- 
vention, which is set forth in the following claims. 
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What is dalmed is: 

1. A method of selecting and switching among a plurality of data 
streams, each data stream comprising a series of elements, comprising 
the steps of: 

5 (a) storing a first subset of the elements; 

(b) selecting one of the data streams; and 

(c) in response to seeking being necessary to access the selected 

data stream, sequentially outputtlng the stored first subset of 
elements while seeking access to the sdected data stream. 

10 2. The method of daim 1. wherein the first subset is sufficiently 

large to cover a period of time at least equal to the time needed to seek 
access to the selected data stream. 

3. The method of daim 1, fiirther comprising the steps of: 

(d) after performing step (c), reading successive elements of the 
15 sdected data stream: 

(e) sequential^ ou^ttlng the successive dements of the sdected 
data stream: and 

(0 dlsciarding stored dements not bdon^g to the sdected data 
stream. 

4. The method of claim 1, wherein step (a) comprises the steps of: 
(a.1) sequentially reading a first subset and a second subset of de- 
ments firom the data streams at a specified read rate, and 
storing eadi dement of the first subset and the sec(md subset; 
and 

(a.2) concurrently with step (a.1), sequentially outputting the stored 
elements of the first subset at a specified output rate, the out- 
put rate being slower than the read rate, to complete step 
(a.1) before step (a.2), and to retain the stored second subset 
after step (a.2) is completed. 

30 5. A method of sdecting and switching between a first data £ftream 

and at least one alternate data stream, each data stream comprising a se- 
ries of dements, comprising the steps of: 

(a) sequentially reading a first subset of elements of the first data 
stream, at a spedfied read rate, and storing each element of 
35 the first subset: 
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sequentially reading a second subset of elements, the second 
subset containing elements from both the first data stream and 
the alternate data stream, at the specified read rate, and stor- 
ing each element of the second subset; 
concurrently with steps (a) and (b), sequentially outputting the 
stored elements of the first subset at a specified output rate, 
the output rate being slower than the read rate, to complete 
steps (a) and (b) before step (c), and to retain the second sub- 
set after step (c) is completed; 
selecting one of the data streams; and 

responsive to the first data stream being selected, sequentiaUy 
reading successive elements of the first data stream v^e se- 
quentially outputting stored elements of the second subset be- 
longing to the first data stream, otherwise, responsive to the 
alternate data stream being selected, seeking access to the al- 
ternate data stream while sequential!/ ou^utting stored ele- 
ments of the second subset belonging to the alternate data 
stream* 

6. A method of selecting and switching between a first data stream 
20 and at least one alternate data stream, each data stream comprising a se- 
ries of elements, and each element having a low resolution version and a 
high resolution version, comprising the steps of: 

(a) sequentially reading the high resolution versions of successive el- 

ements of the first data stream and the low resolution versions 
25 of successive elements of the alternate data stream, at a speci- 

fied read rate, and storing each version of each dement; 

(b) concurrently with step (a), sequentially outputting the stored 

high resolution versions of successive elements of the first 
data stream at a specified ou^ut rate, the output rate being 
30 slower than the read rate; 

(c) selecting one of the data streams; and 

(d) responsive to the alternate data stream being selected, perform- 

ing the following steps: 

(d.l) responsive to there being an insufficient number of ele- 
35 ments in the buffer to cover a period of time equal to the 

time needed to seek access, performing the following 
steps: 



(b) 



5 (c) 



10 



(d) 
(e) 



15 



wo 94/03851 



-23- 



PCr/US93/(IS780 



|d.l.a) sequentially reading the hi^ resolution versions 
of successive dements of the first data stream and 
the low resolution versions of successive elements 
of the alternate data stream, at the specified read 
5 rate and storing each version of each element: 

(d.l.b) concurrently with step (d.l.a). sequentially ex- 
panding and ou^utting the stored low resolution 
versions of successive elements of the alternate 
data stream at a specified output rate, the ouQmt 
10 rate being slower than the read rate: and 

(d.l.c) repeating steps (d.l.a) and (d.l.b) until the num- 
ber of stored elements is sufficient to cover the 
time needed to seek access: 
(d.2) seeking access to the high resolution versions of the ele- 
15 ments of the. alternate data stream, while sequentially 

expanding and outputting the stored low resolution var- 
sions of successive elements of the alternate data 
stream: 

(d.3) after seeking access, sequmtially reading the high reso- 
20 lution versions of successive elements of the alternate 

data stream and the low resolution versicms of successive 
elements of the first data stream, at the specified read 
rate, and storing each version of each element: and 
(d.4) concurrently with step (d.3). sequentially outputting the 
25 stored high resolution versions of successive elements of 

the alternate data stream at the specified output rate. 

7. The method of daim 6. fiarther comprising the steps of: 

(b*) concurrently with step (b). sequentiaUy outputting the stored 
low resolution versions of successive elements of the alternate 
30 data stream at the specified output rate: 

(d.l.b*) concurrently with step (d.l.b). sequentially reducing and 
outputting the stored high resolution versions of successive el- 
ements of the first data stream at the specified output rate: 

(d.2') concurrently with step (d.2), sequentially reducing and out- 
35 putting the stored high resolution versions of successive ele- 

ments of the first data stream: and 

(d.4') concurrently with step (d.4), sequentially outputting the 
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Stored low resolution versions of successive elements of the 
first data stream at the specified output rate. 

8. The method of daim 1, wherein step (sO comprises the steps of: 
(a.1) reading a first subset of elements and storing each element of 
5 the first subset; 

(a.2) after completion of step (a.1), sequentially reading successive 

elemoits and storing each element; and 
(a.S) concuzrently with step (a.2). sequential^ outputting the stored 

elemehts. 

10 9. A method of selecting and switching between a first data stream 

and at least one alternate data stream, each data stream comprising a se- 
ries of elements, comprising tiie steps of: 

(a) reading a firdt subset of elements firom the first data stream and 
storing each element of the first subset: 
15 (b) performing the following steps repeated^ 

(b.l) Quitting a previously stored element: 
(b.2) reading an' element firom the first data stream; and 
(b.3) storing the read element: 
(c) selecting one of the data streams: 
20 (d) responsive to selecting the alternate data stream, performing the 

following steps: 

(d.l) seeking access to the alternate data stream: and 

(d.2) concurrently with step (d.l), sequentially outputting the 

stored elements from the buffer until step (d.l) is com- 
25 pleted: and 

(d.3) after step (d.l) has been completed, sequoitially reading 

and outputting successive elements from the alternate 

data stream. 

10. A method of selecting and switching between a first data stream 
30 and at least one alternate data stream, each data stream comprising a se- 
ries of elements, comprising the steps of: 

(a) reading a first subset of elements from the first data stream and 

storing each element of the first subset; 

(b) performing the following steps repeatedly: 

35 (b.l) outputting a previously stored element: 

(b.2) reading an element from the first data stream: and 



wo 94/03851 PCr/US93/05780 

- 25 - 

« 

(b.3) storing the read element: 

(c) performing the following steps repeatedly: 

(c.l) ou^uttlng a previously stored element belonging to the 
first data stream; 

5 (c.2) reading an element fivm the alternate data stream; and 

(c.3) storing the read element; 

(d) selecting one of the data streams: 

(e) responsive to selecting the alternate data stream, performing the 

following steps: 

10 (e.l) seeking access to the alternate data stream: and 

(e.2) concurrently with step (e.l). sequentially outputting 
previously stored elements belonging to the alternate 
data stream until step (e.l) is completed: and 
(0 sequentially reading and ou^utting successive elements from the 
15 selected data stream. 

1 1. A method of selecting and switching between a first data stream 
and at least one alternate data stream, each data stream comprising a se- 
ries of elements, comprising the steps of: 

(a) reading a first subset of elements from the alternate data stream 
20 and storing each dement of the first subset; 

(b) sequentially reading and outputting successive elements firom the 

first data stream: 

(c) selecting one of the data streams; 

(d) responsive to selecting the alternate data stream, performing the 
25 following steps: 

. (d.l) seeking access to the alternate data stream: and 
(d.2) concurrently with step (d.l). sequentially . outputting 
previously stored elements belonging to the alternate 
data stream from the buffer until step (d.l) Is com- 
30 pleted; and 

(e) sequentially reading and ou^uttlng successive elements firom the 

sdected data stream. 

12. A method of selecting and switching among a plurality of data 
streams, each data stream comprising a series of elements, comprising 

35 the steps of: 

(a) reading an element from each data stream: 

(b) selecting one of the data streams: and 
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(c) oulputting a previously read element corresponding to the se- 
lected data stream. 

13. The method of claim 12. wherein the steps are performed re- 
peatedly. 

5 14. The method of daim 12. wherein the data streams are stored in 

an intedeaved fashion. 

15. Hie method of claim 12, wherein steps (a) and (b) are per- 
formed concurrently with step (c). 

16. A method of sdecting and switching between a first data stream 
10 and at least one alternate data stream, eadi data stream comprising a se- 
ries of elements, comprising the steps oSi 

(a) sequentially reading a first subset of elements of the first data 
stream, at a specified read rate, and storing each element of 
the first subset: 

15 (b) sequentially reading a second subset of elements, the second 

subset containing elements firom both the first data stream and 
the alternate data stream, at the specified read rate, and stor- 
ing each element of the second subset' 

(c) concurrently with steps (a) and (b), sequentially outputtlng the 
20 stored elements of the first subset at a specified output rate. 

the output rate being slower than the read rate, to complete 
steps (a) and (b) before step (c), and to retain the second sub- 
set after step (c) is completed; 

(d) selecting one of the data streams; 

25 (e) reading an element from each data stream; and 

(f) outputting the element corresponding to the selected data 
stream. 

17. The method of claim 16. wherein steps (d), (e). and (f) are per- 
formed repeatedly. 

30 18. The method of claim 16. wherein portions of the data streams 

are stored in an interleaved fashion. 



19. The method of claim 16. wherein steps (d) and (e) are per- 
formed concurrently with step (f). 
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20. A system for selecting and switching among a plurality of data 
streams, eadi data stream comprising a series of dements, comprising: 

(a) means for selecting one of the data streams; 

(b) a storage device for storing the data streams and for seeking ac- 
5 cess to the selected data stream; 

(c) a buffer connected to receive and store data stream elements 

from the storage device: and 

(d) an ou^ut device connected to read and ou^ut data stream ele- 

ments from the buffer while the storage device seeks access to 
10 the selected data stream. 

21. A qrstem for selecting and switching among a plurality of data 
streams, eadi data stream comprising a series of dements, ccnnprising: 

(a) a storage device for storing the data streams in interleaved for- 
mat: 

15 (b) means for selecting one of the data streams; and 

(c) an ou^ut device connected to read and output data stream de- 

ments bdonging to the sdected data stream from the storage 
device. 

22. A e^tem for selecting and switching among a plurality of data 
20 streams, eadi data stream comprising a series of dements, comprising: 

(a) a storage device for storing the data streams, wherein a portion 

of the data streams is stored in interleaved format; 

(b) a buffer coxmected to recdve and store data stream elonents 

from the storage device: 
25 (c) means for selecting one of the data streams; and 

(d) an output device connected to read and output data stream de- 

ments belonging to the sdected data stream from the storage 
device. 



wo 94/03851 



PCTAJS93/05780 



1/15 



101 

CPU 



y 



102 




103 




104 


CD-ROM 


-—^ 


RAM 




Video 


Drive 


DMA 
Transfer 


► 

DMA 
Transfer 


Display 

t 



FIGURE 1 



SUBSTITUTE SHEET 



wo 94/03851 



2/15 



PCr/US93/0S780 



201 



B09 
Pause 




.210 



Output subset 
of 

stream A 
etementsfrom 
buffer 



211 



Accept seleelion input 




Pause -* 



FIGURE2 



SUBSTITUTE SHEET 



wo 94/03851 



PCr/US93/0S780 



3/15 



Tlme-T— > 

I 1 I 2 I 3 I 4 I 5 I 6 I 7 I 

Selectio^ssible 

Read I Ail apI a^I A4I arI rrI rrI abI atI Aft 



8 



Output I A1 I A? I Aa i AA I AS I Afi I A7 I a7 

Buffer's 
contents 

Discarded i i 

from buffer B5 B6 



M |A3|A4|^^|B6|^ |A7| A8 I 



FIGURE 3a 



I .Time— > 

I 1 I 2 I 3 i 4 I 



5 I 6 I 7 I 8 I 
Stream B 



Read I All apI aaI aaI asI rrI rrI Seek I rtI rrI 



Output 

Buffer's 
contents 

Discarded 
from buffer 



A1 i A2 I A3 I A4 I B5 I B6 I B7 I Bft I 



W |A3|A4j^A5|.B6 | 

I 

A5 

FIGURE 3b 



SUBSTITUTE SHEET 



wo 94/03851 



PCT/US93/05780 



407 



Pause 



418 



Pause 



402I 



Read next high-res 




stream A element 




and low-res 




stream B element and 




place in buffer 




Tn 






408 



Output next htgh-res 
stream A element and tovnes 
stream B element from buffer 




Read successive high-res stream A 
elements and lowres sbeam B 
elements.and place in buffer, until 
buffer is fuirenou^ forsedc 



413 



I 



Perfcmnseek 



Output successive low-res 

stream B dements (enlarged) 

and high-res stream A 
elements (reduced) from 

buffer 



415 



419 



Read next high-res 
stream B elenrtent anc 
low-res stream A 
element and place in 
buffer 




416>; 




Output successive high-res 
streams elements and 
kmes stream A elements 
from buffer 



FIGURE 4 



SUBSTITUTE SHEET 



wo 94/03851 



5/15 



PCr/US93/05780 



Time- 
I 1 I 2 



I 3 

BuftorfuB 



I 4 I 5 I 6 I 7 I 



Read 

Output 

Buffer's 
contents 



Pause 



Abll Ab2l Ab3l Ab4l Ab5 1 A b6 I Ab7 I 
ki |At)3|Ab4^ Ab5 I |Ab7| 

FIGURESa 



Time — 

I 1 I 2 I 

UserseleOs 
stnatnB 
I 



3 



I 4 

Bufferfull 



I 



Read 

Output 

Buffer's 
contents 



Seek 



I 5 I 6 I 7 I 



AM I a'B'2 I a'R'3 I a'B'A I a'R'fi I aBfi \ aRT I 
M |Al>3|Ab4gKAb5 I 4b4 |aB7| 



FIGURE 5b 



SUBSTITUTE SHEET 



wo 94/03851 



PCr/l)S93/05780 



6/15 




Read stream A 
efements and 
place in buffer 



603,, 



604 



tead next stream 
Aelementand 



3utput a stream 
A element from 

buffer 




607 



£ 




Perform seek 



Output stream A 
elements from 



Discard stream A 
slements from buffer 



ML 



Read arM output 
successive stream B 
elements ur)til stream 
Bis finished 




FIGURES 



SUBSTITUTE SHEET 



WO94/038S1 



PCTAJS93/05780 



7/15 

Time — ^> 

I il zl 3I 4I si el 7l 8l 

start video 



I 



Read 

Output 

Buffet's 
contents 



All A2l Aal A4l ASl Afil A7l Afll 

fATI A2l Aal A4l A5i ASl A7l Afll 



1 «l jsl 




Asl 


A4| 


Asl 


A6| 








A4i 


ASl 


A6l 


A7l 





FIGURE 7a 



Time ^> 

I1I2I3I415I6 

Start vidBo User selecb 
stream B 



I el 



Read 
Output 

Buffer's 
contents 

Discarded 
from buffer 



I T 

A1 I A2 1 A3 1 A4 I A5 1 A6 1 ATl Seek l B7 1 Bsl 



All A2l Aal A4l ASl ASl B7i Bb1 



A1 1 A1 1 


A2I 


Asl 


A4I 


Asl 


Ael A7| 1 1 


1 A2I 


A3l 


A4I 


ASi 


A6l 


A7I 1 1 1 



I 

A7 



HGURETb 



SUBSTITUTE SHEET 

ft 



wo 94/03851 



PCr/US93/05780 



8/15 




suBsnruTE sheet 



wo 94/03851 



PCTAJS93/05780 



9/15 



Read 

Output 

Buffer's 
contents 

Discarded 
from buffer 



Time > 

I ihhUUUI rial 

Start video 

display Junc^on 
I 

I AllA2lA3lA4lASlB5lB6lA 6lA7lA8l 



All A2lA3l A4lA5lA6l A7l ASI 



A1 1 A1 


A2 


A3 


A4 


A5 


B5 1 1 1 1 


i A2 


IAS 


1 A4l 


ASI 


85 1 


861 i i i 



FIGURE 9b 



I 

B5 
B6 



Time ^> 

I 1 I 2 I 3 I 4 I 5 I 6 I 7 I 8 i 
Startvldeo 

dtsp/a/ Junction 



Read 

Output 

Buffer's 
contents 

Discarded 
from buffer 



A1 I A{> I AS I AA i AS I Rj; I Rft koolr I R7 I Rft i 



Ap I AsI Adl RslRftlRTlRft 



A1 A1 

I A2 



A2 A3 A4 
A3 I A4 I A5 



A5 B6 
B5l 
I 

AS 



FIGURE 9b 



SUBSTITUTE SHECT 



wo 94/03851 



PCrAJS93/05780 



10/15 



1007 , 




Discard Stream B 
elements from 
buffer 




1008 , 




Read and output 
successive 
stream A 
elfiments 






Read Stream B 
elements and 
plaoe In buffer 



*,1003 



Read and output 
nexlstreamA 
element 




input from user 




1009 



1010. 



Perfonnseeic 



Output stream B 
elements from 
buffer 



1012 




J 





Read and output 




succesdye 
steam B 


I — : 





FIGURE 10 



WBSnrUTE SHEBT 



wo 94/03851 



PCr/US93/05780 



11/15 



Time- 

1 I 2 I 3 
Start video 



"II 5l 



I 7l Sl 



Read 

Output 

Buffer's 
contents 



l:.Hl:yi:^li:yiJcli;!li:HiJJiAJi:?:l 



idli:UiJ(ll;!ll;Mij;fl;Vil;?;! 



Discarded 
fromlH.lfer 



B5 B5 



I 

B5 
86 



FIGURE 11a 



Read 

Output 

Buffer's 
contents 



Time > 

I ihisUI 5| el 7| sl 

Slart Video 

JuncHon 
I ______ 

Seek f B7l Bsl 



B5 B5 
I B6 



B6 



FIGURE lib 



SUBSTITUTE SHEET 



wo 94/03851 



PCrAfS93/05780 



1203 



Read next 
element of an 
data streams 




1202 



Read first 
element of aO 
data streams 




1204 



Dete 
whid 
stream 
has 6 


mnlne 
hdata 
the user 
elected 


1205, 




Output jusHread 
element of the 
selected data 
stream 



FIGURE 12 



eUBSnrUTE SHEET 



M> 94/03851 PCr/US93/05780 



13/15 



Time — > 

I 1 I 2 I 3 I 4 I 5 



Read I Ail ml Agl B2I Aal eal A4l baI asI rrI 



Output 



I A1 I A9 \ Aa 



FIGURE 13a 



Time ^> 

I 1 I 2 I 3 I 4 I 5 I 

Userselects 

Read I All Bll A2I B2I A3I B3l A4| B4l A5l B5 
Output I A1 I A2 I B3 



B4 I B5 I 



FIGURE 13b 



fiWBSTITOTE SHEET 



wo 94/03851 



PCr/US93/05780 



14/15 



-/start > 



1406 

Read next element and 
place in buffer 



1408 



Pause 




1411 



I 



Read next 
element (el 
A or B) and place 
in buffer 



1410, 



Output sut)set of 
stream A elements 
from buffer 



1415. . 



Detemrine which 
data stream the user 
has selected 



1416i 



Output an element 
oftheselededdata 
stream from the 
buffer 



1417 I 



Discard an element 
non^le^data 



stream 




FIGURE 14 

SUBSTITUTE SHEET 



wo 94/03851 



PCr/US93/05780 



15/15 



, Time • 
I 1 I 2 



5 I 6 I 
^SetecSon pos&l^ le 



] 8 I 



Read I All A2I A3 1 A4| A5l B5 I B6 I A6 1 B7 I A7 1 A8 I A9 



OlrtPUt I A1 I A2 I A3 I A4 I A5 I A6 i A7 i A8 IA9 



Buffer's 
contents 

Discarded 
from buffer 



M I A3|A4|^5|^|B8|g | 87 | 



I 

85 



I 

87 



FIGURE 15a 



1112 



I 3 I 4 I. .5 1.6 I 7 I 



Read 

Output 

Buffer's 
contents 

Discarded 
from buffer 



U&Brseleis 



7 I 8 I 
Return to 



A1 1 A2l A3l A4l ASl BS I Bfi I Afil B7l A7l AR I 



A1 I A2 I A3 I A4 I AS I Rfi I R7 I Aft 



|A2| I A3| A4 



A5| B6 
85 ' 
I 

BS 



B7 



A6 



I 

A7 



FIGURE 15b 



SUBSnrUTESHEET 



INTERNATIONAL SEARCH REPORT 



Intetnalioaal appOadon No. 

PCT/US 93/05780 



A. CLASSinCATION OP SUBJECT MATTER 



IPCS: fi06F 3/00. G06F 12/00 _ 



Aeeowllngi 



B. FIELDS SEARCHED 



Mbiimom doeunimtulon mrchcd (ctanWcttlon system foUowed by dis sB teatfo n symboU) 
IPC5: G06F, G09G, GllB 



Deeumemaiioo scarehed other than ninimttra tfoeumenuiion to tha eaent that sueb doeunMnu are included In die fWds searched 



Bicetroiiie dau bast eeiitulted doling the Intematienal search (name ofdaubaM and, where' practicable, search terms used) 



C DOCUMENTS CONSIDERED TO BE RELEVANT 



Cat^ory* 



Qtalion or doeumenC wttb indicadon. where appropriate, of die relevant passages 



Relevant to daim No. 



US, A, 4849828 (SHIGERU YASUDA ET AL)» 
18 July 1989 (18.07.89) 

column 1, line 62 - column 2, line 57; column 4, 
line 39 - column 6, line 35 



Philips Tech. Rev,, Volume 44, No 11/12, November 
1989. B.A.6. van Uiyt et a1, "The Compact Disc 
Interactive system" page 326 - page 333 



US, A, 4931984 (YOSHIHIDE NY), 5 June 1990 

(05.06.90), column 6, line 1 " column 9, line 46 



1.2.8.9, 
12-15,20-22 

3-5,10,11, 
16-19 



1.2,4,8,9, 
12,14,20-22 



3.5.10,11, 
16-19 



1,8,9,20-22 



nn FanlMrdoeaaanttafwBrtedintfMeoaliniiatteaerBoxC ^ []Q Sea patent ftm^rnnex. 



ID bt of pwtlnttMf rIcviboi 

If Vm"" p4«4ty tkaim{J^ wWeh t« 

cUiA ft) ^ft>^)Ufh ttiB puUictfloo ditt at rittTlffli or other 

^ doGaoKBtitMsf toaaonldisdonin,as«,c3[M^ 

'P* ^'^'j^y t prior 10 ttM iatsniiioaal fiU2i$ ditB tot Uter Itua 

tte prtotlQf ditt ctttoffi 



^l** tttBT ^ fy ! '" n * " > i^i^ BifiM titer tfas tstsnistioQil fifixis daos 
datt aadttot ia oooflia w(ih ite mUeuiaa but cited to 
tbB priiKlple er Theoty nodcdylBg mo i&i«odoa 



priocUy 



of iMflicBiJir RtsvaoB Iht djiinol iavcadoa 
aovdoresnaotbe ' ' 



i to'iavolvo aa iaveadvo acp wfaca tfao 

^ J 011^ or Bioro ortiflr nidb 

bdof obvioiif to • pom skUled b tte m 

r of ttw nae pans Cudiy 



Date of the actual completioa of th« tticmaiional search 



12 October 1993 



Name and mtiUna address of Ihe ' 

Eureeean Pauet onioe, i818 Piceaaaan 2 

^7/ Ttie(4-)t<.?0)340.104Q.Tx;3l 65t cpe nl, 
Fex;(-m*70)34MOI6 ^ ' 



J) 



Data of fflatling of the liiternatioaal search report 

29.m93 



Authorized officer 

Bo Gustavsson 



Form PCT/ISA^IO (seeood sheet) (iuty W2) 



INTERNATIONAL SEARCH SEPOBT 



Intarnadonal appDeaiiea No. 
PCT/US 93/05780 



C(Goiitiiiiution). DOCUMENT^OONSIDBRED TO BE RELEVANT 



Ouegofy* 



Cttatfon of doeumeat, with Indeation. where appropriste, of liM nUvant paiuges 



Rdevant 10 No. 



6B. A, 2229889 (BRIHSH BROADCASTING CORPORATION), 
3 October 1990 (03.10.90), see the whole document 



EP, A2, 0465053 (SONY CORPORATION), 8 January 1992 
(08.01.92) 

abstract 



EP, A2, 0492938 (SUN MICR0SYSTB4S, INC.).- 
1 July 1992 (01.07.92), abstract 



1.12-15,21 



1.2.4,8 



5,10,11.16, 
17,20-22 



1.21 



FWm PCr/iSAy2tO (eoaimuKian of Moood ihcei) (July IS52) 



SA 633 



IhriERNAnONAL SEARCH REPORT 
Information on patent taxeUy member* 



26/08/93 



Inteniatioaal qppfleadoa No. 
PCT/US 93/0S780 



Patentd 


oeoment 


PubBeadoa 


Pliant ftmfly 
' incBibai{i) 


PubBcidon 


cited in M 


ifcii ffport 


date 


dite 


US-A- 


4849828 


18/07/89 


JP-A- 


63054081 


08/03/88 






JP-A- 


63054082 


08/03/88 








JP-A- 


f 9 AC 

63053776 


08/03/88 








JP-A- 


63059285 


15/03/88 


lie A 

US-A- 


4931984 


AC /AC /OA 


DE-A- 


3826158 










JP-A- 


1036374 




6B-A- 


2229889 . 


03/10/90 


GB-A- 


2260463 




EP-A2- 


0465053 


08/01/92 


JP-A- 


4061089 


27/02/92 








AU-A- 


7933391 


02/01/92 








CA-A- 


2045052 


30/12/91 








CM-A- 


1057921 


15/01/92 








JP-A- 


4061069 


27/02/92 








US-A- 


5214631 


25/05/93 


EP-A2- 


0492938 


01/07/92 


CA-A- 


2058251 


22/06/92 



• 



Pom PCT/I8A/210 (patent famity inmi) (July t992) 



